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DETAILED ACTION 

Response to Arguments 

1 . Applicant's response to the last Office Action, filed 12/22/2008, has been entered and 
made of record. 

2. Applicant has amended claims l-17.Claims 19-21 has been added. Claims 1-17, 19-21 
are currently pending. 

3. Applicants' arguments filed 3/12/2009 with respect to the rejection(s) of claim(s) 1-17 
under 103(a) have been fully considered but they are not persuasive. 

Applicant argues that that Delecags does not show the claimed 2D having sub areas with access 
to a 3D database. Examiner refers to Delongacz abstract and section two where hybrid 
algorithms have been developed that combine the pure image- and object-order approaches to 
take advantage of their best characteristics and result in improved quality as well as greater 
rendering speed. An example hybrid technique is a shear-warp factorization algorithm. 
Delongacz teaches a segmentation filter to enhance the lung boundaries and filter out small and 
medium bronchi from of 2D images. The 2D images were further processed with the contour 
extraction method to segment out only the lung field for further study. In the next step the 
segmented lung images containing the small bronchi and lung textures were used to generate the 
volumetric dataset input for the three-dimensional visualization system. Additional processing 
for the extracted contour was used to smooth the 3-D lung contour in order to eliminate edge 
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discontinuities related to bronchi as well as abnormalities (e.g. nodules) located close to the lung 
boundaries. The computer program developed allows, among others, viewing of the three- 
dimensional lung object from various angles, zooming in and out as well as selecting the regions 
of interest for further viewing. The density and gradient opacity tables are defined and used to 
manipulate the displayed contents of 3-D rendered images. Thus, an effective "see-through" 
technique is applied to the 3-D lung object for better visual access to the internal lung structures 
like bronchi and possible cancer masses. These and other features of the resulting 3-D lung 
visualization system give the user (physician) a powerful tool to observe and investigate the 
patient's lungs. Therefore, Delongacz teaching will read on "presenting image data that 
represents a three dimensional object in a space generating projection data which represents twp 
dimensional projection". Moreover, the recitation "presenting image data that represents a three 
dimensional object in a space" has not been given patentable weight because the recitation 
occurs in the preamble. A preamble is generally not accorded any patentable weight where it 
merely recites the purpose of a process or the intended use of a structure, and where the body of 
the claim does not depend on the preamble for completeness but, instead, the process steps or 
structural limitations are able to stand alone. See In re Hirao, 535 F.2d 67, 190 USPQ 15 
(CCPA 1976) and Kropa v. Robie, 187 F.2d 150, 152, 88 USPQ 478, 481 (CCPA 1951). 
Applicant argues that Cheng-Seng et al fails to specifically teach the detailed image is shown on 
the screen within a sub region. Examiner disagrees with applicant since this feature is shown on 
page 55 (last page) the image is in the center row on the left therefore it is obvious to apply that 
feature in a medical visual display system in order to arrive at an image-in-image display. All 
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remaining arguments are reliant on the aforementioned and addressed arguments and thus are 
considered to be wholly addressed herein. 


Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or 
described as set forth in section 102 of this title, if the differences between the subject 
matter sought to be patented and the prior art arc such that the subject matter as a whole 
would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived 
by the manner in which the invention was made. 

5. Claims 1-13,16-18 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Delegacz et al (Three-dimensional visualization system as an aid for lung cancer detection ) in 
view of Cheng-Sheng et al ( Fast volume rendering for medical image Data). 

As to claim 1, Delegacz et al teaches a method for presenting image data (1) that 
represents a three-dimensional object (7) in a space ( see abstract) , comprising generating 
projection data which represents a two-dimensional projection (6) of the object (7)( hybrid 
technique, paragraph 2, page 402) by computational superimposing multiple image planes ( 
employ the 2-D paradigm, slice sequence of 2D images, page 402, paragraph 2) , and displaying 
the projection (6) on a monitor for viewing by a user ( note that 2D images can significantly 
enhance the ability to understand the overall 3-D, picture , page 402, paragraph 2, figure 4) , 
wherein a sub-area (8) is selected from the projection (6) ( selecting the regions of interest for 
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further viewing , see abstract), and a detail image (9) having different information content than 
the projection (6) is generated inside the sub-area (8), and displaying the detail image (9) is 
displayed within the sub-area (8) on the monitor ( paragraph 2, figure 4) . While Delegacz meets 
a number of the limitations of the claimed invention, as pointed out more fully above, Delegacz 
fails to specifically teach the " displaying the detailed image within the sub-area on the monitor". 
Specifically, Cheng Sheng et al. teach the display of the image (x, y) in the center row (see page 
55, section 2.2-2.3, left image), it would have been obvious to one of ordinary skill in the art to 
locate the image within the sub region in Delegacz display in order to see more clearly the inside 
structure of the human body, thus achieving the goal of simulated surgery. Therefore, the 
claimed invention would have been obvious to one of ordinary skill in the art at the time of the 
invention by applicant. 

As to claim 2, Delegacz et al teaches method in accordance with claim 1, wherein the 
detail image is generated in direct or indirect recourse to the image data (1) from 
which the projection is generated, and this image data (1) is collected in a first data record 
(shear- warp factorization algorithm; saving the single rendered frame to a disk file, section 5.2, 
page 406). 

As to claim 3, Delegacz et al teaches the method in accordance with claim 1, further 
comprising the user selecting one of several possible detail images (9), which differ in their 
information content (the user interface allows, among others, to change the size of displayed 
slices, fwd or rewind the slices, the user can choose the full set of slices including the 
intermediate ones or the collection of original slices only, section 5.1, page 405). 
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As to claims 4 and 8, Cheng-Sheng et al teaches method in accordance with claim 1, 
wherein a detail image (9) is a sub-projection (10) which differs from the projection (6) in that 
the depth of field is greater and fewer image planes (4) are superimposed when sub-projections 
(10) with higher depth of field are generated than when projections (6) are generated. 
(The simulated surgery that produces sub projection with a relatively high clarity of depth since 
few layers are superimposed; section 2.3). 

As to claim 5, Delegacz et al teaches method in accordance with claim 4, wherein the 
plane (4) of the sub-projections (10) is parallel to the plane of the projection (6) ( sequence of 
consecutive frames in parallel, paragraph 2; see also Cheng-Sheng figures on page 50). 

As to claim 6, Delegacz et al teaches the method in accordance with claim 1, wherein a 
separate window is opened on the monitor, in which various sections are displayed by the object 
(7) within the frame of the selected sub-area (8) ( figure 4). 

As to claim 7, Delegacz et al teaches the method in accordance with claim 1, wherein a 
volume presentation or a surface display takes place in the separate window (paragraph 5.2 and 
figures 9 and 10). 

As to claim 9, Delegacz et al teaches method in accordance with claim 1, wherein exactly 
one image plane (4) represents a sub-projection (10) ( see figure 4). 

As to claim 10, Delegacz et al teaches method in accordance with claim 1, wherein the 
user has interactive access to the image information in the sub-area (8) by moving a 
pointer instrument to scroll among different layers parallel to the projection 
planes (interactive software module, section 5.2, page 406, see also abstract). 
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As to claim 1 1 , Delegacz et al teaches the method in accordance with claim 1 , wherein 
the image data represents a part of a human or animal body and is recorded with a diagnostic 
system (lung image, section 5, pages 405-406). 

As to claim 12, Delegacz et al teaches the method in accordance with claim 11, wherein 
the image data is recorded with a computer tomography (CT), a magnetic resonance tomography 
(MR), or by digital volume tomography (DVT) (In the particular area of lung imaging aimed to 
support screening and diagnosis of lung diseases the radiographic methods like conventional X- 
ray (XR) and computed tomography (CT) are most commonly used, page 402, Introduction) 

As to claim 13, Cheng-Sheng teaches the method in accordance with claim 11, wherein 
the image data is recorded with a C-arch, which is rotated around the object (see Introduction). 
6. Claims 14-15 are rejected under 35 U.S.C. 103(a) as being unpatentable over Delegacz 
et al (Three-dimensional visualization system as an aid for lung cancer detection ) in view of 
Engel et al ( Combing local and remote visualization techniques for interactive volume rendering 
in medical applications). 

As to claim 14, Delegacz et al teaches the method in accordance with claim 1, wherein 
the detail image is generated with direct or indirect recourse to the image data, which is collected 
in a second data record, wherein this image data originates from 

another recording of the object (before submission to the 3D system the input data is usually 
preprocessed with segmentation algorithms to select the object of interest, the final result is 
either the 3D surface or volumetric representation of the acquired dataset, paragraph 2, page 402, 
and section 5.2). While Delegacz meets a number of the limitations of the claimed invention, as 
pointed out more fully above, Delegacz does not explicitly teaches the second data set. 
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Specifically, Engel et al. teaches the use of different data sets where a 3D representation 
of high quality the whole volume or a selected sub volume is rendered with 3D texture mapping 
on the remote graphics hardware (see figure 9). This strategy is also indispensable if the fusion 
of different data sets is performed to achieve better anatomical understanding (see figure 10). It 
would have been obvious to one of ordinary skill in the art to record different data sets with 
different device and in Delegacz in order to achieve better anatomical understanding. Therefore, 
the claimed invention would have been obvious to one of ordinary skill in the art at the time of 
the invention by applicant. 

The limitations of claims 16-17 has been addressed above. 

As to claim 19, Delongacz teaches the system according to claim 17, wherein the means 
is a mouse, a trackball or a joystick (page 405, figure 4, it is obvious to use of the following 
means (trackball, mouse. . .) to select the slices). 

As to claims 20-21, Delongacz teaches the method of claim 3 wherein said information 
content is the depth, or perspective, or type of display or the depth of information represented by 
the detail image( section 5.2; note that Delongacz method deals with any clinical display) 

Conclusion 

7. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 
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A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to NANCY BITAR whose telephone number is (571)270- 
1041 . The examiner can normally be reached on Mon-Fri (7:30a.m. to 5:00pm). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Vikkram Bali can be reached on 571-272-7415. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Nancy Bitar/ 
Examiner, Art Unit 2624 


/Vikkram Bali/ 

Supervisory Patent Examiner, Art Unit 2624 


